W&TERMARXING TECHNIQUE FOB. SCALED IMAGE 



BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention relates to image data processing 
techniques and in particular to a waterm.ark.ing and watermark 
detecting system and method for a scaled-up/down image. 

2. Description of the Prior Art 

With wide-spreading digital satellite broadcasting, the 
Internet, and DVD (Digital Versatile Disk) , etc. in recent years, 
digital images are becoming easily accessible to users. Since 
the quality of digital images does not deteriorate when they 
are copied, copyright protection has been an important issue. 

t-'or protection of video contents, motion-picture or 
still-picture contents and the like, there has been proposed 
a digital watermarking system. More specifically, at a contents 
provider, watermark data is embedded into DOT (discrete cosine 
transform) coefficient domain of compressed image daLst. Al <s 
user terminal, it is checked whether a watermark is embedded 
in the input image data. When the watermark has been detected 
from the input image data, Uhe watermark detection result is 
displayed and thereby copying can be effectively prevented (see 
Japanese Patent Application Unexamined Publication No. 10- 
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Oa tha other hand, with the widespread use of DVD recorders, 
there has been a growing trend to permit a user to copy the content 
of a DVD only a limited number of times, usually only once. The 
limited number of times is determined by a copy control watermark 
5 previously embedded in the image content of the DVD. In the case 
of a copy-once watermark indicating that a copy is permitted 
only once,, an appended-type watermark is embedded in the image 
content when the copy has been performed. When the 
appended-type watermark is detected from an input image content, 

10 the dvd recorder prohibits any copy. Such a copy protection 
system effectively prevents wide-spreading illegal copies. 

Accordingly, reliable dcLeclion of such a watermark is 
a very important issue to enhance the copy protection. 

In some casES, however, an input image having a copy 

15 control watermark embedded therein may be scaled up/ down by using 
a video editor and the 1 i Ve. . Tt. is known that such scaling makes 
detection of an appended-type watermark difficult . For example, 
when a watermarked image has been scaled by a horizontal factor 
Sx and vertical factor Sy, it is necessary to scale an 

20 appended-type watermark by the Sdins fdcLor be£ure embedding it 
into the scaled watermarked image. When the scaling factor of 
the scaled appended-type watermark is equal to that of the scaled 
watermarked image, the appended-type watermark can be detected 
with reliability even if the scaled watermarked image having 

25 the scaled appended-type watermark embedded therein is scaled 
again . 
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However, in the case where the scaled watermarked image 
having the scaled appended- type watermark embedded therein is 
scaled again, the original appended-type watermark is eventually 
scaled two times. This deteriorates the detection accuracy of 
5 the appended-type watermark. On the other hand, when the 

appended-type watermark is embedded into the scaled image, it 
is necessary to scale down the appended-type watermark two times. 
This increases the size of a necessary program. 

SUMMARY Of TII£ INVENTION 

10 It is an object of the present invention to provide 

watermarking and watermark detecting system and method allowing 
an appended-lypc watermark to be inserted into a scaled-up/down 
image without deteriorating the detection accuracy of the 
appended-type watermark avert if the scaled watermarked image 

15 having the scaled appended-type watermark embedded therein is 
scaled again. 

According to the present invention, a watermarking system 
includes: a first detector for detecting a first scaling factor 
of an input watermarked image by detecting a first watermark 
20 from the input watermarked image, wherein the first watermark 
includes copy control information, used for copy generation 
limitation; a second detector for detecting a watermark 
including a second scaling factor from the input watermarked 

- 3 - 
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image; and a controller controlling such that, when the second 
detector fails to detect the watermark including the second 
scaling factor, a second watermark including the first scaling 
factor is created and embedded into the input watermarked image 
5 and further an appended-type watermark is inserted into the input 
watermarked image to produce an output watermarked image having 
the first, second, and appends*!- type watermarks therein. 

The watermarking system further includes an appended- 
type watermark dulcclur for detecting the appended-type 

10 watermark 'from the input watermarked image based on a third 
scaling factor calculated from the first scaling factor and the 
second scaling factor, wherein the controller controls such that , 
when the second detector has detected the watermark including 
the second scaling factor, the first and second scaling factors 

lb arc used to calculate the third scaiing factor. 

The first detector may search for the first watermark 
while scaling the input watermarked image in steps of a 
predetermined small amount. The third scaling factor may be 
calculated by dividing the first scaling factor by the second 

20 scaling factor. 

According to another aspect of the present invention, a 
watermark .i nserting method includes the steps of: a) detecting 
a first scaiing factor of an input watermarked image by detecting 
a first watermark from the input watermarked image, wherein the 

25 first watermark includes copy control information used for copy 
generation limitation; b) determining whether a watermark 



FQ5-570 



including a second scaling factor is detected from the input 
watermarked ims.ge; and c) when the watermark including the second 
scaling factor fails to be detected, creating a second watermark 
including the first scaling tactor; and d) embedding the second 
5 watermark and an appendsd-type watermark into the input 

watermarked image to produce an output watermarked image having 
the first, second, and appended-type watermarks therein. 

The step a) may include the steps of: a.l) scaling the 
input watermarked image in steps of a predetermined small amount; 
10 a. 2) determining whether the first watermark i.s detected from 
a scaled input watermarked image; and a. 3) when the first 
watermark is detected from an input watermarked image scaled 
by a scaling factor, determining the scaling factor as the first 
scaling factor of the input watermarked image. 
15 According to another aspect of the present invention, a 

watermark detecting method includes the steps of: a) detecting 
a first scaling factor of an input watermarked image by dele cling 
a first watermark from the input watermarked image, wherein the 
first watermark includes copy control information used for copy. 
20 generation limitation; b] determining whether a watermark 

including a second scaling factor is detected from the input 
watermarked image; andc) when the watermark including the second 
scaling factor has been detected, calculating a third scalinq 
fflr.ror from the first scaling factor snri r.he second scaling 
25 factor; and d) detecting an appended-type watermark from the 
input walermarked image based on the third scaling factor. 

- 5 - 
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According to further another aspect of the. present 
invention, a digital image recorder for recording an input 
watermarked image in a digital recording medium, includes: a 
first detector for detecting a first scaling factor of the input 
5 watermarked image by detecting a first watermark from the input 
watermarked image, wherein the first watermark includes copy 
control information used for copy generation limitation; a 
second detector for detecting a watermark including a second 
scaling factor from the input watermarked image; an 

10 appended-type watermark detector for detectinq an appended- 
type watermark from the input watermarked image based on a third 
scaling factor calculated from the first scaling factor arid the 
second scaling factor; and a controller controlling such that., 
when the second detector fails to detect the watermark including 

lb the second scaling factor, a second watermark including the first 
scaling factor is created and embedded into the input watermarked 
image and further the appended-type watermark is insarted into 
the input watermarked image to produce an output watermarked 
image having the first, second, and appended-type watermarks 

20 therein, and, when the second detector has detected the watermark 
including the second scaling factor, the first and second scaling 
factors are used to calculate the third scaling factor. 

As described above, according to the present invention, 
the appended-type watermark is inserted into an input, image 

25 without, scaling it. Accordingly, there is no need of scaling 
programs for scaling the appended-type watermark and therefore 



FQ5-570 



the insertion of the appended-type watermark becomes easy, 
further, the detection accuracy of the appended- type watermark 
is improved even if the image having the appendcd-type watermark 
inserted therein is scaled thereafter. 



5 BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a diagram showing a watermarking and watermark 
detecting system according to a first embodiment of the present 
invention; 

Fig. 2 is a diagram showing a scaling factor detecting 
10 method employed in the first embodiment; 

Fig. ,i is a. block diagram showing an example of the 
watermarking and watermark detecting system according to the 
first embodiment of the present invention; 

Fig . 4 is a flow char t .showing a wa termarkiny and watermark 
15 detecting method in the system as shown in Fig. 3; 

fig. 5 is 3 block diagram showing a watermarking and 
watermark detecting system according to a second embodiment of 
the present invention; and 
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Fig. 6 is a block diagram showing a watermarking and 
watermark detecting system according to a third embodiment of 
the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Referring to Fig. 1, it is assumed for simplicity that 
an original watermarked image I (W) is scaled up/down twice using 
scaling factors SI and S2, respectively. 

At a content provider 1.01, a well-known electronic 
watermarking method is used to embed a watermark W including 
copy control information into an original image I to produce 
the original watermarked image I (W) . The copy control 
information is N-bit data that may indicate "copy-once", 
"copy-protection", or "copy-free". 

The original watermarked image I £W} is subjected to 
scaleup or scaladown, for example, in a tranceiver, an image 
processor or the like. Here, the original watermarked image 
I (N) is scaled by the scaling factor SI to produce a. scaled image 
I ai (W sl ) , wherein not only the image X but also the watermark W 
is scaled by the same scaling factor SI , which is represented 
by a suffix "SI". 

When inputting the scaled image I,|(W S ,) , a scaling factor 
detection step 10? is performed at user's equipment such as a 
DVD recorder. An all scaling search method is used to detect 
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watermark (here, w(Sl) ) is found in the twice-scaled watermarked 
image I s , s _, (W sls ^, W(SD H , "appsj) ' a scaling factor is extracted from 
the scaling factor watermark (here, the scaling factor SI) . 

The total scaling factor SI x S2 at the step 104 and the 
5 extracted scaling far.r.nr SI at. the step 105 are used to precisely 
calculate the scali rig factor S2, thai is, S2 = (SlxS2)/Sl (step 
10S) . Here, since the appended-Lype watermark W„. p has been 
inserted without scaled at step 103 and then scaled by the scaling 
factor 52, it can be reliably detected from the twice-scaled 

10 watermarked image I-,-, ! W^.,, W(S1). ?/ W 4> „,) using the detected 
scaling factor S2 (step 107 } . 

Referring Lo Fig. 2, the all scaling search method will 
be described. Given the input scaled image Tsi' W 5i'' *- s 
sequentially scaled in steps of a predetermined small amount 

15 while determining whether a watermark W is detected. When the 
watermark W is detected, the scaling factor at that time is used 
as a scaling factor by which the input scaled image 1=., (W sl ) has 
been scaled. For example, in the case where the input scaled 
image r 3l (W 5 , ) has been scaled down by the scaling factor SI, the 

70 watermark W is detected when the input scaled image I il (W sl ) is 
scaled up by the scaling factor SI. 

Referring to Fig. 3, an e-xample of the watermarking and 
watermark detecting system according to a first embodiment of 
the present invention will be described. Tn this example, a B.S 

?-5 (Broadcasting Satellite) antenna 11 and a BS digital tuner 12 
arc provided as a digital image input means. Each of DVD 
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recorders 13 and 16 has a first function of detecting the copy 
control watermark W, a second function of detecting a scaling 
factor of Che copy control watermark W, a first watermark, 
inserting function of inserting an appended-type watermark W APP/ 
a third function of detecting the appended-type watermark W nw>> , 
and a second watermark inserting function of inserting a scaling 
factor watermark W{S1) . A DVD player 14 performs only DVD 
playback. A VCR editor 15 is capable of enlarging or reducing 
an input image. 

When receiving digital watermarked image I (W) by the BS 
antenna 11, the BS digital tuner 12 scales it and outputs a scaled 
digital image J.,, (W^,) to the DVD recorder 13. When inputting 
the scaled image l st (W yl ), the DVD recorder 13 performs the all. 
scaling search method to detect a scaling factor SI from the 
input scaled image I.,, (W s , ). Thereafter, the DVD recorder 13 
inserts an appended-type watermark W Al<l ., and. embeds a scaling 
factor watermark. W(S1) into the scaled image I^tW^) to produce 
a seal ed, uatermarked image I s , (W st , W (SI) , W 1PV ) , which is recorded 
into a DVD. The scaling factor watermark W(S1) is a watermark 
including the detected scaling factor SI. 

The digital image I sl ( W sl , 1 W ( S 1 ) , w M , r ) is played ' bac k by 
the DVD player 14 and then output to the VCR editor 15. The VCR 
editor 15 converts the digital image I sl (W sl , W(S1), W^J into 
an analog signal, edits it by scaling and the like, and then 
records the edited signal in a magnetic tape. The VCR editor 
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15 outputs an analog scaled watermarked image ( w sl , ,, W(Slj 
w A „ 3 ,) to the nvo recorder IS. 

When inputting the twice-scaled watermarked image 
I^isjtW,,.,., W(Slj >:i , W A[ ,,, V ,) from the VCR editor IS, the DVD recorder 
16, a.s dfisr.nhfid before, detects the total scaling factor SI 
x S2 and the extracted scaling factor 51 to calculate; the scaling 
factor S2 and then detects the appended-type watermark from 
the twice-scaled watermarked image I SIS . ( w sls . , WtSl)..,, w ip „.,) using 
the detected scaling factor 52. 
Warprm*rk i n^Prhi nn/dsrRct i ng 

A watermark inserting and detecting operation of the DVD 
recorders 13 =md_ 16 will be described with reference to Fig. 
4. Here, ssch of the nvn recorders 13 and 16 has functions as 
indicated by reference numerals 102-107 of Fig. 1, which may 
be implemented by a program-controlled processor. 

Referring to Fig. 4, when the DVD recorder 13 has inputted 
the scaled image I 5 i(W sl ) from the BS digital tuner 12, the DVD 
recorder 13 uses the all scaling factor search method to detect 
the scaling factor SI and the watermark W„ from the input scaled- 
image I,,(W S1 ) (step Al). 

Subsequently, the DVD recorder 13 determines whether a 
scaling factor watermark W(S) including a scaling factor 
information is detected from the input scaled image I sl (W^) (step 
A?l . At the DVD recorder 13, .since the scaled image I S1 (W s ,) has 
never been copied by a DVD recorder, such s. scaling factor 
watermark W(S) is not found in the scaled image I sl (W 3l ). 
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Accordingly, the DVD recorder lid creates a scaling factor 
watermark W(S1) using the scaling factor SI detected at the step 
Al and embeds it into the scaled image I u (W sl ) (step A3), and 
further inserts an appended-type watermark W ACT that is not scaled 
5 into the scaled image I sl (W ril ) to produce a scaled, watermarked 
. image I,, (W., , VI {SI) , W ni . H ) (step A4). This scaled, watermarked 
image I.i(W M , W(S1), W iK „) is recorded in the DVD. 

The scaled and watermarked image I st (W sl , W(S1), W Al , L ,l 13 
output to the VCK editor 15 through the UvD player After 

10 ■ scaling at the VCK editor 15 by the scaling factor S2, the DVQ 
recorder 1C inputs the twice-scaled and watermarked image 
Isisz (W sl52 , W(S1) 5I , W„„,) from the VCR editor 15. 

When the DVD recorder 16 has inputted the image I sia , (W ils ,, 
W(Sl) s; , W„,,, s .) , the DVD recorder 16 uses the all scaling lacLur 

15 search method to detect a present scaling factor (here, SI x 
S2) by detecting the watermark from the input image I S1S , ( W S1 ,,.,, 
W (SI) s: , W M . rs;J ) (step Al) . 

Subsequently, the DVD recorder 16 determines whether a 
scaling factor watermark W(S) including a scaling factor 

20 information is detected from the input image I Rl .„ (W„,„*, W(S1),., 
w apfdv) (step A?) . At. the DVO recorder 16, since the input image 
I, 13J ( W, x _-_., W(S1) :2 , w APr ;:) has been copied, the scaling factor 
watermark W(S1) is found in the input image I SIS ^ (W flls _., W(31). v , 
W Afi't,J • Accordingly, the DVD recorder 16 extracts the scaling 

25 factor SI fcorathe scaling factor wdLcnuiik B (SI) and calculaLes 
the scaling factor S2 from the present scaling factor (here, 
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51 x S2) and the extracted scaling factor SI (step A5) . The DVD 
recorder IS uses the calculated scaling factor SP. to detect the 
appended-type watermark W AtT from the image T 5lS2 (M SIS?/ W(Sl) 5: , 
H tfts ,) (step A6) . 

5 As described above, at the step A4, the appended-type 

watermark W AP .. is inserted into the scaled image I si (W 31 ) without 
scaled. Accordingly, there is no need of scaling program for 
scaling the appended-type watermark W AL , L , and therefore the 
insertion of the appended-type watermark W A „ (step A4 ) becomes 
10 easy. Further, the detection accuracy of the appended-type 
watermark W V1 . (step A6) is improved even if the image having the 
appended-type watermark W APP inserted therein is scaled 
therea f ter . 

In the case where the VCR. editor 15 is not provided, the 
15 operation of the system is the same as when the scaling factor 

52 = 1. 

Referring to Fig. 5, an example of the watermarking and 
watermark detecting system, according to a second embodiment of 
the present invention will be described. In this example, a DVD 
20 recorder 21, a VCR editor 22, and UVU recorders 23,- 24 are 
provi ded . 

The DVD recorder 21 records a watermarked image I(W) as 
an image content. The watermarked image I (W) is scaled by a 
scaling ractor SI to produce a scaled image I SI (W M ) at the VCR 
25 editor 22 similar to the VCR editor 15 of Fig. 3. The scaled 
image l vl (W sl ) is output to the DVD recorder 2.1. 
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When inputting the scaled image I 51 CW sl ) , the DVD recorder 
23, as described in Fig. 4, determines whether a scaling factor 
watermark W(S) including a scaling factor information is 
defected from the input scaled image I ax (W sl ) . At the OVD recorder 
5 23, such a scaling factor watermark W(S) is not found in the 
scaled image I sl <w sl ) . Accordingly, the DVD recorder 23 creates 
a scaling -factor watermark W(S1) using the scaling factor SI 
detected at the step Al and embeds it into the scaled image I„ l (W ai ) , 
and further inserts an appended-type watermark w,,,, that is not 

10 scaled into the sealed image I El (W sl ) to produce a scaled, 

watermarked image I sl (W 4l . W(S1) , W Aa .) . This scaled, watermarked 
image I^tW^, W(S1). W Mn .) is recorded in the DVD. 

When the scaled and watermarked imaqe I 31 (W 3l , W(S1) , W„„„) 
stored in the DVD recorder 23 is copied to another DVD, the DVD 

15 recorder 24 inputs the image I,,^,,,, W(S1), W AP? ) from the DVD 
recorder 23. The DVD recorder 24 uses the ail scaling factor 
search method Lo detect a present scaling factor (here, SI) by 
detecting the watermark W C1 from the input image I el (W s , , W(S1), 
W A „} . 

20 Subsequently, the DVD recorder 24 determines -whether a 

scaling factor watermark W(S) including a scaling factor 
information is detected from the input image I^W^, W(S1), w ?pr ) . 
At the DVD recorder 246, since the input image I r ,i^^> W (S1), 
w„„„) has been copied at the DVD recorder 23, the scaling tactor 

25 watermark H(S1) is luurid. Accordingly, the DVD recorder 24 
extracts the scaling factor SI from the scaling factor watermark 
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w(b"i) and calculates the scaling factor S2 by dividing the 
present scalinq factor SI by the extracted scaling factor St, 
that is, 52-1. The DVD recorder 24 uses tha calculated scaling 
factor S2 = 1 Lo detect the appended-type watermark W ARf , from the 
5 image I^IW^, W(S1), w Acr ) . 

Referring to fig. 6, an example of the watermarking and 
watermark detecting system according to a third embodiment of 
the present invention will be described. In this example, a 
digital recording medium 31 such as a DVD, a VCR editor 32, a 
10 nvn recorder 33, a DVD player 34, a VCR editor 35, and a DVD 
recorder 36 are provided. 

The digital recording medium 31 stores a watermarked 
image I(W) as an image content. The watermarked image I(WJ is 
scaled by a scaling factor SI to produce an analog scaled image 
■ 15 l.n( w 5l ! at the VCR editor 32 similar to the VCR editor 15 of Fig. 
3. The analog scaled Image I S1 (W s , ) is output to the DVD recorder 
33. 

When inputting the analog scaled image I RI (W ff , ), the DVD 
recorder 33, as described in Fig. 4, determines whether a scaling 

20 factor watermark W(S) including a scaling factor information 
is detected from the input scaled image I,, (W sl ) . At the nvn 
recorder 33, such a scaling factor watermark W(S) is not found 
in the scaled image I., (W,.,) . Accordingly, the DVD recorder 33 
creates a sea li ng factor watermark W(S1) using the scaling factor 

25 SI and embeds it into the scaled im<±yu I SI (W S1 ) , and further inserts 
an appended-type watermark W lep that is not scaled into the scaled 
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image I 5l (W 5l ) to produce a scaled, watermarked image I fll (w SJ , W(S1) , 
W APt .J . This scaled, watermarked image I ?l (W s) , W(SLJ, W APP ) is 
recorded in the DVD and output to the DVD player 34. The 
. operations of the DVD player 34, the VCR editor 35, arid the DVD 
recorder 36 are the same as those of the DVD player 14, the VCR 
editor 15, and the DVD recorder IS as shown in Fig. 3. 

In the second and third embodiments, as similar to the 
first embodiment, the appended-type watermark W A1 , P is inserted 
into the scaled image l„, (w sl ) without scaled. Accordingly, there 
is no need of scaling program for scaling the appended- type 
walcrmark W A1 „. and therefore the insertion of the appended-type 
watermark «„,.„ becomes easy. further, the detection accuracy of 
the appended-type watermark W„ p is improved even if the image 
having the appended-type watermark W„ pp iuserled therein is 
scaled thereafter. 

In the case of copy-once watermark embedded in an image 
content, when the image content is copied once at a DVD recorder, 
an appended-type watermark is appended and therefore a further 
copy is prohibited. Another embodiment of the present invention 
may be designed to prohibit a further copy when the image content 
has been copied a predetermined number of times. For example, 
each the image content is copied, the appended-type watermark 
is inserted and, when its copy count reaches the predetermined 
number of times, a further copy is prohibited. According to the 
present invention, the appended-type watermark can be detected 
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stably and reliably and therefore copy protection can be made 
with reliability. 
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